(19) 




Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(11) EP1 215 876 A1 

EUROPEAN PATENT APPLICATION 



(43) Date of publication: 

19.06.2002 Bulletin 2002/25 

(21) Application number: 01310345.2 

(22) Date of filing: 11.12.2001 



(51) lntCI7. H04N 1/21 



(84) Designated Contracting States: 


(72) Inventor: Imaeda, Eiji 


AT BE CH CY OE DK ES Fl FR GB GR IE IT LI LU 


Ohta-ku, Tokyo (JP) 


MC NL PT SE TR 


Designated Extension States: 


(74) Representative: 


ALLTLVMK RO SI 


Beresford, Keith Denis Lewis et al 




Beresford & Co., 


(30) Priority: 14.12.2000 JP 2000380419 


2-5 Warwick Court, 


(71) Applicant: CANON KABUSHIKI KAISHA 


High Hoiborn 


London WC1R 5DJ (GB) 


Tokyo (JP) 



(54) Image storage system 

(57) A communication device having a memory for 
storing image data and thumbnail data is capable of 
transmitting the image data to an image storage unit. 
When the communication device transmits some of the 
image data stored in the memory, it erases the transmit- 
ted image data in the memory to increase an area in the 



memory where data can be stored. The communication 
device transmits to the image storage unit a search re- 
quest for searching for the image data corresponding to 
the selected thumbnail data during browsing of the 
thumbnail data, and receives the image data found by 
searching from the image storage unit. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to a communica- 
tion device and a communication system. 

Related Background Art 

[0002] Remarkable progress has been made in wire- 
less communication technology in recent years. A third 
generation mobile communication system based on a 
wideband code division multiple access (W-CDMA) sys- 
tem and called International Mobile Telecommunica- 
tions-2000 (IMT-2000) forms a communication network 
capable of data transfer at a rate of 384 kbps in a mobile 
communication environment. 

[0003] An international standardization organization 
called Third Generation Partnership Project (3GPP) ad- 
vances a process of standardizing IMT-2000 and suc- 
cessively releases the IMT-2000 standard specification, 
which are made public on a web site (http://www.3gpp, 
org/) or through other media. 

[0004] Further, IMT-2000 is the first system having in- 
troduced therein a user identification module called a 
Universal Subscriber Identify Module (USIM). A right 
granted to a user to use a portable telephone, which is 
conventionally assigned to the portable telephone by 
usersubscription, is incorporated in one USIM. The user 
can use any of a plurality of communication units under 
the same usersubscription by attaching the USIM to the 
communication unit. 

[0005] Meanwhile, in digital cameras, image data is 
generally managed in accordance with a standard 
called Design rule for Camera File system (DCF). DCF 
is an image file format standard prescribed in JEIDA- 
492-1998 by Japan Electronic Industry Development 
Association (JEIDA). Image data to be stored is com- 
pressed into a DCF file by JPEG (Joint Photographic 
Experts Group) compression. 

[0006] Here, JPEG compression is an image coding 
method for compressing image data in such a manner 
that original image data undergoes discrete cosine 
transform on a predetermined block basis to be convert- 
ed into data per frequency components, and data com- 
ponents of little visual influence in maintaining image 
quality are removed from the image data. 
[0007] Conventionally, an image communication sys- 
tem is known in which an image photographed with a 
digital camera is transferred to a computer in a remote 
location by wireless communication through a commu- 
nication line. 

[0008] in a digital camera used in such a conventional 
image communication system, data on a photographed 
image is transferred to an internal frame memory, the 
data in the frame memory is JPEG-compressed by an 



internal CPU, and the compressed data is stored in DCF 
format in amemory card. An operator operates the cam- 
era to transfer the stored image data from a wireless 
communication unit to an image server to store the data 

s in the same. 

[0009] Fig. 2 shows a format of the image data to be 
transferred at this time. Referring to Fig. 2, a portion 201 
is SOT (Start Of Transmission) designating the begin- 
ning of a transferred frame; a portion 202 is transfer 

10 length information indicating the length of the trans- 
ferred frame, a portion 203 is SOI (Start Of Image) des- 
ignating the beginning of the DCF data; a portion 204 is 
APP1 information (e.g. : date and time information) in ac- 
cordance with the DCF standard; a portion 205 is JPEG 

*5 compressed image data in accordance with the DCF 
standard; a portion 206 is EOI (End Of Image) informa- 
tion designating the end of the DCF data; and a portion 
207 is EOT (End Of Transmission) designating the end 
of transferred data. 

20 [0010] Information between SOI information 203 and 
EOI information 206 is the DCF data in accordance with 
the DCF standard. 

[0011] In the above-described conventional image 
communication system, an entire image photographed 
25 with the digital camera is transferred to an image server 
and no information on the transferred image is left on 
the digital camera side. 

[0012] When image data is transferred from the image 
server, APP1 information (e.g., date and time informa- 

30 tion) about image data stored in the image server is 
transferred to the digital camera side by an operation on 
the digital camera side to be checked. The operator se- 
lects necessary image data by referring to the date and 
time information. The selected information is transferred 

35 to the digital camera to enable the operator to view the 
image. 

[0013] In the above-described conventional system, 
however, only the date and time information can be re- 
ferred to on the digital camera side as information for 

40 identification of images, which is transferred from the im- 
age server. Therefore, the operator cannot check 
whether a transferred image is an image selected by the 
operator until the corresponding image data is trans- 
ferred and displayed. If images other than the selected 

45 image are transferred, transfer time and commun ication 
cost for the operation are wasted. 
[0014] In a case where the image server is shared by 
a plurality of persons, images other than those trans- 
ferred by one person may be stored in the image server. 

50 in such a situation, the above-described problem is 
more serious. 

[0015] Situations in which the above-described prob- 
lem may arise are not limited to the case of transfer of 
images photographed with the digital camera to the inv 
55 age server. That is, there arises also the same problem 
in a case where an image stored in a personal computer 
is erased after the image has been transferred from the 
personal computer to an image server. 
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[0016] The problem of difficulty in selecting an image 
to be viewed by referring to the date and time informa- 
tion is not limited to the case where a person who trans- 
ferred an image to an image server views the image by 
himself or herself. There arises also the same problem 
in a case where some other person wishes to view the 
image. 

SUMMARY OF THE INVENTION 

[001 7] A concern of the present invention is to provide 
a communication device or a communication system 
having improved operability. 

[0018] Another concern of the present invention is to 
provide a communication device or a communication 
system designedto avoid a reduction in operability while 
saving memory capacity. 

[0019] Still another concern of the present invention 
is to provide a communication device or a communica- 
tion system in which an image to be transferred can be 
checked in advance by means of thumbnail data before 
transfer of the image from an image server. 
[0020] A further concern of the present invention is to 
provide a communication device or a communication 
system in which a user can search for image data 
through the communication device connected to a pub- 
lic network by using user information for identification of 
the user on the public network side. 
[0021] These and other advantages and features of 
the present invention will become apparent from the fol- 
lowing detailed description of preferred embodiments of 
the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0022] 

Fig. 1 is a diagram showing communication flow in 
an image communication system in an embodiment 
of the present invention; 

Fig. 2 is a diagram showing a format of conventional 
transferred data; 

Fig. 3 is a block diagram of a digital camera in the 

embodiment of the present invention; 

Fig. 4 is a block diagram of an image server in the 

embodiment of the present invention; 

Fig. 5 is a diagram showing a format of transferred 

data in a system in the embodiment of the present 

invention; 

Fig. 6 is a diagram showing a format of thumbnail 
data in the system in the embodiment of the present 
invention; 

Fig. 7 is a diagram showing a construction of the 
image communication system in the embodiment of 
the present invention; 

Fig. 8 is a flowchart of the digital camera in the em- 
bodiment of the present invention; 
Fig. 9 is a flowchart of the digital camera at the time 
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of data transfer in the embodiment of the present 
invention; 

Fig. 10 is a flowchart of the digital camera at the 
time of display of a fine image in the embodiment 
5 of the present invention; and 

Fig. 1 1 is a flowchart of the image server in the em- 
bodiment of the present invention. 

DESCRIPTION OF THE PREFERRED 
10 EMBODIMENTS 

[0023] Fig. 3 is a block diagram showing the configu- 
ration of a digital camera which is a communication de- 
vice in an embodiment of the present invention. This dig- 
*5 ital camera is one of devices having image storage func- 
tions as well as communication functions. The digital 
camera is an example of a device which has a means 
for inputting image data, and in which input image data 
is stored in a memory. The present invention can be ap- 
20 piied to a personal computer having an image pickup 
unit or a portable telephone. 

[0024] Referring to Fig. 3, the digital camera has a 
camera body 300, an operation unit 301 , a memory 302, 
a charge coupled device (CCD) unit 303, a compression 
unit 304, a decompression unit 305, a display unit 306, 
a communication unit 307, a USIM 308, an antenna 309, 
and a control unit 31 0 for overall control of the operation 
of the digital camera. 

[0025] The operation unit 301 is an operation input 
unit through which the operation of the digital camera is 
controlled by an operator. The operation unit 301 is con- 
stituted by a power switch, a shutter button, a mode 
change switch, a selecting switch, and a communication 
control switch. 

[0026] The memory 302 stores image data, including 
compressed data and thumbnail data output from the 
compression unit 304 described below. The memory 
302 can also store image data received from the com- 
munication unit 307 described below. Further, a pro- 
gram for the control unit 310 is stored in the memory 
302. The memory 302 is constituted by a nonvolatile 
flash memory. 

[0027] The CCD unit 303 is constituted by a lens unit 
having an automatic focusing function, a CCD light re- 
ceiving device, and a CCD control circuit. Data on an 
image formed by light imaged on the CCD light receiving 
device through the lens unit is read out and transferred 
to the compression unit 304 by the CCD control circuit. 
[0028] The compression unit 304 performs JPEG 
compression processing on image data transferred from 
the CCD unit 302, and transfers the compressed data 
to the memory 302. The compression unit 304 also pre- 
pares thumbnail image JPEG data and transfers this da- 
ta to the memory 302. In the present invention, a com- 
pression method other than JPEG may alternatively be 
used. 

[0029] The decompression unit 305 performs JPEG 
decompression processing on JPEG compressed data 
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or thumbnail data from the memory 302 to restore the 
original image data. Image data decompressed by this 
decompression processing is transferred to the display 
unit 306 to be displayed. 

[0030] The display unit 306 displays image data trans- $ 
ferred from the decompression unit 305 and control in- 
formation for identification of images by the operator un- 
der the control of the control unit 300. 
[0031] The communication unit 307 is arranged to re- 
alized IMT-2000 communication functions. The commu- 10 
nication unit 307 operates under the control of the con- 
trol unit 31 0 to transfer image data %.o an image server 
in a remote location or receive image data transferred 
from the image server through a public wireless net- 
work. In the present invention, a wireless commu nica- is 
tion method other than IMT-2000 may alternatively be 
used. Also, the present invention can be realized in a 
cable communication system. 

[0032] The USIM 308 is a user authentication module 
(Universal Subscriber Identity Module) in accordance 20 
with the IMT-2000 standards. The USIM 308 is con- 
structed so as to be detachably attached to the digital 
camera. In a nonvolatile memory section in the USIM 
308, user authentication information is written. More 
specifically, a charging-target telephone number is writ- 25 
ten in the USIM 308. When the calling operation to con- 
nect to the public network is performed by using the tel- 
ephone number, a person who owns the USIM 308 with 
the telephone number is charged for the communica- 
tion. In the case of a system not using the USIM for user so 
authentication, a telephone number is stored in the 
memory 302. 

[0033] The control unit 310 has a clock function for 
managing date and time, and records the date and time 
of photography of each of photographed images while 35 
storing the photographed images in the memory 302. 
The control unit 310 operates on the basis of the pro- 
gram stored in the memory 302. 
[0034] Data output from the compression unit 304 will 
be described in more detail. 40 
[0035] Generally, in digital cameras, image data is 
managed in a data format called Design rule for Camera 
File system (DCF). In the digital camera 300 in accord- 
ance with the present invention , image data is also man- 
aged in a format in accordance with DCF. 45 
[0036] DCF is a file format for use in digital cameras 
settled on the basis an image file format standard known 
as Exit. In DCF, a file frame configuration and a directory 
configuration are prescribed. 

[0037] Details of the standard for DCF are prescribed so 
in the standards JEIDA49-2-1 998 issued from the Ja- 
pan Electronic Industry Development Association. De- 
tails of the standard for Exif are prescribed in the stand- 
ards JE1DA-49-1998 also issued from the Japan Elec- 
tronic Industry Development Association. 55 
[0038] In DCF format, APP1 (Application marker seg- 
ment 1 ) information indicating various sorts of informa- 
tion about an image and data on the JPEG compressed 



basis image are set in a data frame defined between 
SOI (Start Of Image) designating the beginning of the 
data frame and EOI (End Of Image) information desig- 
nating the end of the data frame. A JPEG compressed 
thumbnail image can be included in APP1 information. 
In DCF format, the size of a thumbnail image is fixed at 
160 x 120 pixels. 

[0039] JPEG compression will be outlined below. 
JPEG, which is standardized by ISO (International Or- 
ganization for Standardization) and ITU-T (International 
Telecommunication Union Telecommunication Stand- 
ardization Sector), is an image coding method which 
compresses image data so that the amount of data is 
reduced to about 1/1 0 to 1/1 00. 

[0040] In the JPEG compression method, blocks of 
image data in predetermined two-dimensional regions 
are treated as units, and image data in each block is 
converted into data per frequency components by dis- 
crete cosine transform (DCT), thus compressing the im- 
age data. If the compression rate is increased, the im- 
age quality degrades. To improve the image quality, the 
compression rate is reduced. 

[0041] IMT-2000 on which the method for communi- 
cation by the communication unit 307 is based will be 
described. 

[0042] IMT-2000 is a communication network of a 
third generation mobile communication system based 
on a Wideband CDMA (W-CDMA) system to which a 
code division multiple access (CDMA) method was ap- 
plied as a wireless communication method. 
[0043] in IMT-2000, a data transfer rate of 368 kbps 
at the maximum in a mobile environment and a data 
transfer rate of 2048 kbps at the maximum in a fixed 
environment are practicable. 

[0044] The process of standardizing IMT-2000 is be- 
ing advanced by 3GPP, which is an international stand- 
ardization organization. IMT-2000 standards thereby 
set are being successively released and are made pub- 
lic on a web site (http://www.3gpp.org/) or through other 
media. 

[0045] Meanwhile, in the present invention, a wireless 
communication method other than IMT-2000 may alter- 
natively be used. Also, a frequency division multiplex 
(FDM) communication method, a time division multiplex 
(TDM) communication method, or the like may alterna- 
tively be used. The present invention can also be real- 
ized in a cable communication system. 
[0046] Fig. 4 is a block diagram of an image server 
which is an image storage/search apparatus in the em- 
bodiment of the present invention. 
[0047] Referring to Fig. 4, the image server has an 
image server body 400, a memory 401 , a hard disk (HD) 
402, a display unit 403, an operation unit 404, a com- 
munication unit 405, a USIM 406, an antenna 407, and 
a control unit 408 for overall control of the operation of 
the image server. 

[0048] The memory 401 is a work memory used by 
the control unit 408 when data received by the commu- 
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nication unit 405 or JPEG compressed data in the HD 
402 is decompressed to restore the original image, or 
in other situations. 

[0049] The HD 402 is a storage device in which a 
processing program which runs in the control unit 408 5 
and data received by the communication unit 405 are 
stored. 

[0050] The display unit 403 is constituted by a cath- 
ode ray tube (CRT) display on which the state of oper- 
ation of the image server and image data are displayed. 10 
[0051] The operation unit 404 is an operation input 
unit through which the operation of the image server is 
controlled by an operator. The operation unit 404 is con- 
stituted by a keyboard, a mouse, and a power switch. 
[0052] The communication unit 405 is arranged to re- 15 
alized IMT-2000 communication functions, as is the 
above-described communication unit 307. The commu- 
nication unit 405 operates under the control of the con- 
trol unit 400 to transfer image data to the digital camera 
in a remote location or receive image data transferred 20 
from the digital camera through the public wireless net- 
work. In the present invention, a wireless communica- 
tion method other than IMT-2000 may alternatively be 
used. Also, the present invention can be realized in a 
cable communication system. 25 
[0053] The USIM 407 is a user authentication module 
(Universal Subscriber Identity Module) in accordance 
with the IMT-2000 standards, as is the above-described 
USIM 308. The USIM 407 is constructed so as to be 
detachably attached to the image server. In a nonvolatile 30 
memory section in the USIM 407, user authentication 
information is written. More specifically, a charging-tar- 
get telephone number is writtealn the USIM 407. When 
the calling operation to connect to the public network is 
performed by using the telephone number, a person 35 
who owns the USIM 407 with the telephone number is 
charged for communication. In a case where the server 
400 is connected to a communication system requiring 
no USIM, it is not necessary to connect the USIM 406 
to the server 400. 40 
[0054] Meanwhile, the communication unit 404 of the 
image server 400 is not limited to the type using a wire- 
less communication system. The communication unit 
404 may be connected to the public line to the Internet 
by means of a cable. 45 
[0055] The operation of an image communication sys- 
tem constituted by the digital camera 300 and the image 
server 400 will now be described. 
[0056] The configuration of the image communication 
system is as shown in Fig. 7. so 
[0057] In Fig. 7 are illustrated a public wireless net- 
work 703, a base station 701 to which the digital camera 
300 functioning as a communication terminal in the pub- 
lic wireless network 703 is connected, and a base sta- 
tion 702 to which the image server 400 functioning as a 55 
communication terminal in the public wireless network 
703 is connected. The image server 400 may be con- 
nected to the public wireless network 703 via a public 



cable network (ISDN, PSPN) or the Internet used in 
place of the base station 702 and the public wireless 
network 703. 

[0058] The digital camera 300 performs the calling op- 
eration to connect to the image server 400 via the base 
station 701 and the base station 702 to perform com- 
munication of image data : etc. 

[0059] A sequence for transfer of data between the 
digital camera 300 and the image server 400 will be de- 
scribed with reference to Fig. 1 and Figs. 8 to 1 1 . In Fig. 
1 , the states of intervention of the base station 701 and 
the base station 702 between the digital camera 300 and 
the image server 400 are omitted. Figs. 8, 9, and 10 are 
flowcharts showing the operation of the control unit 31 0 
of the digital camera 300, and Fig. 11 is a flowchart 
showing the operation of the control unit 408 of the im- 
age server 400. 

[0060] The control unit 310 of the digital camera 300 
is a computer which reads out a program stored in the 
memory 302 to perform the operation shown in Figs. 8 
to 1 0. The flowcharts in Figs. 8 to 1 0 show a part of the 
program stored in the memory 302 provided as a stor- 
age medium so as to be readable by the computer. 
[0061] Similarly, the control unit 408 of the image 
server 400 is a computer which reads out the program 
stored in the memory 401 to perform the operation 
shown in Fig. 11. The flowchart in Fig. 11 shows a part 
of the program stored in the memory 401 provided as a 
storage medium so as to be readable by the computer 
[0062] When the digital camera 300 is operated for 
picture taking (shooting) (S910), the CCD unit 303 per- 
forms picture taking and an image thereby obtained by 
the CCD unit 303 is compressed into JPEG data by the 
compression unit 304 and written in DCF format to the 
memory 302 (S91 1 ). The data written in DCF format at 
this time is formed of SOI, APP1 including the photog- 
raphy date and time information and a thumbnail image, 
the JPEG compressed image data, and EOI, as de- 
scribed above. The format of the image data is not lim- 
ited to DCF, and any other format may alternatively be 
used. In such a case, the compression method is not 
limited to JPEG. 

[0063] When the photographer takes several pic- 
tures, data in DCF format corresponding to the number 
of pictures taken is stored in the memory 302. 
[0064] If in this state the operator operates the com- 
munication control switch of the operation unit 301 to 
input an instruction to establish connection to the image 
server 400 (S920), the control unit 31 0 of the digital cam- 
era 300 controls the communication unit 307 to establish 
connection F1 to the image server 400 (S921 ). Thiscon- 
nection processing is unnecessary if a continuous con- 
nection type of communication system is used. 
[0065] Connection to the image server 400 is execut- 
ed by the operator of the digital camera 300 performing 
the calling operation to the telephone number assigned 
to the USIM 406 on the server 400 side. 
[0066] The operator then operates the transfer switch 
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of the operation unit 301 (S930). The control unit 310 
reads out thumbnail data shown in Fig. 6, stored in the 
memory 302, and displays a list of the thumbnail data 
on the display unit 306 (S1031 ). When the operator se- 
lects by the selecting switch some of the images which 
he or she wishes to transfer to the image server 400 
(S1032), connection is established (SI 034) if connec- 
tion to the server 400 is not completed (S1 033). The op- 
erator performs selecting in this step while checking the. 
image to be transferred on the display unit 306. 
[0067] The control unit 310 generates data to be 
transferred, in which, as shown in Fig. 5, ID information 
503 and 504, header information 501 and 502 and EOT 
(End Of Transmission) information 509 designating the 
end of the frame are added to the DCF data 505 to 508 

(51 035) . The DCF data is the image data obtained by 
picture taking in step S911. APP1 in this data includes 
thumbnail data and the photography date and time in- 
formation. 

[0068] The header information is formed of SOT (Start 
Of Transmission) information 501 designating the be- 
ginning of the data to be transferred, and information 
502 indicating the data length of the entire frame. The 
ID information is formed of telephone number informa- 
tion 503 read out from the USIM 308 provided as a de- 
tachable component, and the date and time data 504 
written in APP1 information 506. This telephone number 
information may be stored in the memory 302. 
[0069] Telephone number information 503 is informa- 
tion for identification of the public wireless network 703 
subscriber who is to be charged from the public wireless 
network 703 for use of the same. In this system, tele- 
phone number information 503 is information for identi- 
fication of the person who is to be authenticated as a 
user of the digital camera 300. If the image server 400 
is offered a caller identification notification service from 
the public wireless network 703, it is not necessary to 
include this identification information in the data to be 
transferred. ID information other than telephone number 
information 503 may be provided for identification of the 
user by the server 400. Also, the image server 400 may 
generate discrimination data for discrimination of stored 
images and send the data to the digital camera 300. 
[0070] The control unit 310 transfers (F2 to F4) the 
generated data in the form of a wireless communication 
signal from the communication unit 307 to the image 
server 400 over the public wireless network 703 

(51036) . In the example shown in Fig. 1, three images 
are transferred. 

[0071] The control unit 31 0 of the digital camera 300 
reconstructs the transferred data into a frame without 
JPEG data 507 and stores the reconstructed data in the 
memory 302 (S1037). The frame formed by removing 
JPEG data 507 has a frame configuration formed only 
of ID information and thumbnail data, as shown in Fig. 
6. This thumbnail data is data obtained by bit reduction 
from JPEG data 507 to indicate features of JPEG data 
507 by an amount of data smallerthan that of JPEG data 



507. Since JPEG data is removed as described above, 
the empty space for storage of image data obtained by 
picture taking in step S911 can be increased. This data 
reconstruction and saving in step S1037 may be per- 
s formed before data is stored by picture taking newly per- 
formed in step S91 1 afterthe completion of data transfer 
in step S1036. 

[0072] When the control unit 408 of the image server 
400 receives the data formed as shown in Fig. 5 and 

io transferred from the digital camera 300 (S1202) at the 
time of incoming from the digital camera 300 (S1201), 
it stores in the HD 402 the transferred data received 
through the communication unit 405 (S1203). If at this 
time stored image data having the same ID as the ID 

is information in the transferred data exists in the HD 402, 
the transferred data is written over the image data al- 
ready stored. Of the ID information in the data generated 
in step S1035 to be transferred, the telephone number 
information may be removed from the data to be trans 

20 ferred, if the image server 400 is notified of the tele- 
phone number by a caller number notification service. 
[0073] If another image is transferred to the image 
server 400 (S1 038), generation of data to be transferred 
is performed again. When selection of and transfer of 

25 images to be transferred are completed (S1038), the 
control unit 310 of the digital camera 300 cuts (F5) the 
connection with the image server 400 (S1039). That is, 
after the completion of data transfer (F2) shown in Fig. 
1, the process returns from step S1038 to step S1032 

30 to execute data transfer (F3). After the completion of da- 
ta transfer (F4), the process advances from step S1038 
to step S1 039 to cut the connection with the image serv- 
er 400. 

[0074] When data transfer by the above-described 

35 procedure is completed, the thumbnail data shown in 
Fig. 6 is stored in the memory 302 on the digital camera 
300 side and the transferred data shown in Fig. 5 is 
stored in the HD 402 on the image server 400 side. 
[0075] Regarding each of images not transferred to 

40 the server 400, a larger amount of image data for fine 
representation of the image is stored in the memory 302. 
On the other hand, the control unit31 0 of the digital cam- 
era 300 stores in the memory 302 the smaller amount 
of image data for rough representation of the image 

45 transferred to the server 400. 

[0076] That is, larger amounts of image data for fine 
representation of the images are stored in the image 
server 400, while smaller amounts of image data for 
rough representation of the images transferred to the 

so image server 400 are stored in the digital camera 300. 
Also, discrimination data for searching the larger 
amounts of image data for fine representation of the im- 
ages is stored in the image server 400, and discrimina- 
tion data for searching the smaller amounts of image 

55 data for rough representation of the images is stored in 
the digital camera 300. The digital camera 300 stores 
the thumbnail image data and the discrimination data in 
a state of being related to each other, and the image 
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server 400 stores the fine image data and the discrimi- 
nation data in a state of being related to each other. 
[0077] This discrimination data includes the tele- 
phone number of the digital camera 300, i.e., data for 
identification of the public wireless network 703 sub- 5 
scriber, and data on the date and time of photography 
of each image. When the smaller amount of image data 
for rough representation of one image is transmitted 
from the digital camera to the image server 400, the im- 
age server 400 searches for the larger amount of image 10 
data for fine representation of the image on the basis of 
the discrimination data transmitted from the digital cam- 
era 300. 

[0078] While the discrimination data including the us- 
er identification number and data on the date and time 15 
has been described, any other data may be used if it 
enables a selected image in a plurality of images to be 
discriminated from the others. Such discrimination data 
for searching images may be prepared in the image 
server 400 and sent to the digital camera 300. 20 
[0079] To browse thumbnail data, the operator of the 
digital camera 300 performs an operation for browsing 
(S940). The control unit 31 0 then displays on the display 
unit 306 data on one or a plurality of thumbnail images 
stored in the memory 302 of the digital camera 300 to 25 
enable the operator to browse the images (S941). Im- 
age data stored in the memory 302 includes image data 
having JPEG data and image data having no JPEG da- 
ta. However, the control unit 31 0 reads out the thumbnail 
image data contained in APP1 from either type of image so 
data and displays the thumbnail image data on the dis- 
play unit 306. 

[0080] If the operator wishes to view some finer image 
from the displayed thumbnail images, he or she oper- 
ates the operation unit 301 on the digital camera 300 35 
side to select the thumbnail of the fine image to view 
(S942). If the selected image is one having its JPEG da- 
ta 507 removed in step S1 037 (S1 141 ), and if the digital 
camera 300 is not connected to the image server 400 
(S1142) ; the control unit 310 performs the calling oper- 40 
ation to connect (F6) to the image server 400 (S1143). 
This connection processing is unnecessary in a case 
where a continuous connection type of communication 
system is used. 

[0081] Further, the control unit 310 transmits (F7) to 45 
the image server 400 a command (search request) for 
transmission of the image data containing ID informa- 
tion 604 and 605 in the thumbnail data stored in the 
memory 302 (S1144). This command is transmitted as 
a wireless communication signal from the communica- so 
tion unit 307 to the image server 400 over the public 
wireless network 703. Of this ID information, the tele- 
phone number information may be removed from the 
transmission command if a caller number notification 
service is used. 55 
[0082] When receiving this command (request) 
(S1204), the control unit 408 of the image server 400 
searches a plurality of groups of image data stored in 



the HD 402 and having the format shown in Fig. 5 to 
identify the corresponding image data from the received 
ID information. The control unit 408 transfers (F8) the 
identified image data to the digital camera 300 through 
the communication unit 405 (S1205). Caller information 
notified in a caller information notification service may 
be used as ID information. If information other than the 
information for identification of the subscriber to be 
charged from the public wireless network 703 for use of 
the same is provided as ID information, this ID informa- 
tion may be used. 

[0083] if there is no data corresponding to the re- 
ceived ID information in the stored image data, the im- 
age server 400 sends a command indicating the ab- 
sence of the data to the digital camera 300. 
[0084] When the control unit 31 0 of the digital camera 
300 receives the image data as a wireless signal from 
the communication unit 307 (S1145), it writes the re- 
ceived image data to the memory 302. Simultaneously, 
the control unit 310 deletes the thumbnail data corre- 
sponding to the received data (S1 1 46), which has been 
stored in the memory 302, because this thumbnail data 
becomes useless. Alternatively, the received JPEG data 
507 may be added to the thumbnail data already stored 
in the memory to be stored. 

[0085] This received image data has an amount of da- 
ta largerthan that of the thumbnail data and enables fine 
representation of the image. Deletion of the thumbnail 
data may be performed at the time of the next picture 
taking instead of being performed at this step. 
[0086] The fine image is displayed on the display unit 
306 on the basis of the received image data (S1147). 
This fine image is displayed more finely in comparison 
with the thumbnail image displayed in step S941 . 
[0087] However, if the command indicating the ab- 
sence of the necessary data is received by the digital 
camera 300, the control unit 310 displays a message 
indicating the absence of the corresponding data on the 
display unit 308 (S1148). 

[0088] If the operator of the digital camera 300 wishes 
to another fine image (S1149), the process returns to 
step S941 and the operator selects another image from 
the displayed thumbnails. When the corresponding ID 
information is transmitted (F9) to the image server 400, 
the image server 400 reads out the stored image data 
corresponding to the received ID information from the 
HD 402 and transmits (F1 0) the image data to the digital 
camera 300. The digital camera 300 again stores the 
received image data in the memory 302 and deletes the 
corresponding thumbnail data. 

[0089] If JPEG data 507 corresponding to the select- 
ed thumbnail is stored in the memory 302 without being 
deleted, this data is read out from the memory 302 and 
displayed on the display unit 306 (S1147). 
[0090] To terminate transfer of fine image data from 
the image server 400, the control unit 310 of the digital 
camera 300 cuts (F11) the connection with the image 
server 400 (S1150). 
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[0091] In the digital camera 300, the vacant memory 
space in the memory 302 can be displayed (S951) on 
the display unit 306 by an operation through the opera- 
tion unit 301 (S950) to be checked. When the remaining 
memory space becomes small, the image data in the 
memory 302 may be transferred to the Image server by 
the above-described procedure to delete the image data 
while leaving only the thumbnail data. In this manner, 
the vacant memory space (area for storage of image da- 
ta obtained by picture taking in step S91 1 ) in the memory 
302 can be increased. This deletion of JPEG data may 
be performed before picture taking newly performed af- 
ter the completion of data transfer to the image server 
400. 

[0092] The digital camera 300 may be operated 
through the operation unit 301 to delete the image data 
in the memory 302 without transferring the data. It is also 
possible to delete the thumbnail data. 
[0093] While the image file format has been described 
as a format in accordance with the DCF standard : image 
files may be formed in any other different format. Images 
obtained by picture taking are not limited to still images. 
Image data on moving images and sound may also be 
handled in the system of the present invention. Moving 
images may be compressed by an MPRG method to be 
stored instead of being JPEG compressed. In such a 
case, a typical scene (e.g., a first scene after a start of 
picture taking, or a scene designated by the operator) 
may be compressed and stored as JPEG thumbnail da- 
ta. 

[0094] That is, the memory 302 stores moving image 
data and typical scene data. When moving image data 
is transmitted through the communication unit 307 
(S1036), the transmitted moving image data is deleted 
from the memory 302 to increase an area in the memory 
302 where data can be stored (S1 037). In the browsing 
mode (S940), if one of typical scenes stored in the mem- 
ory 302 is selected (S942), a search request for search- 
ing for the image data corresponding to the selected typ- 
ical scene is transmitted from the communication unit 
307 to the image server 400. 

[0095] While the wireless communication means in 
accordance with IMT-2000 has been described, any oth- 
er wireless communication means may alternatively be 
used. If a wireless communication means different from 
the described one is used, the identification means may 
be constituted by a memory card or the like in which a 
telephone number is stored, other than the USIM. 
[0096] While an example of digital camera 300 in 
which the communication unit 307 is incorporated has 
been described with reference to Fig. 3, a digital camera 
provided as an image communication device may be 
connected to a portable telephone capable of wireless 
communication over public wireless network 703 by a 
cable or short-distance wireless communication (e.g., 
wireless communication by a frequency hopping meth- 
od) to send image data by wireless communication. 
[0097] In such a case, for the data 503 for identifica- 



tion of a user, user identification data may be added to 
data to be transferred in the digital camera or user iden- 
tification data may be added in the portable telephone. 
Further for the date and time data 504, the photography 
5 date and time information is added to data to be trans- 
ferred in the digital camera or the transfer date and time 
information is added in the portable telephone. Data oth 
er than the date and time information may be provided 
as discrimination data for searching transferred images. 
10 [0098] If image discrimination data is prepared on the 
portable telephone side in the case where thumbnail da- 
ta is stored on the digital camera side, the portable tel- 
ephone sends the discrimination data to the digital cam- 
era and the digital camera stores thumbnails in a state 
of being related to the discrimination data. 
[0099] The present invention can also be applied to a 
personal computer or a portable telephone having no 
CCD unit 303 and having images input thereto from a 
memory card. After fine image data in the memory card 
has been transferred to the image server, it is replaced 
with a smaller amount of data, i.e., thumbnail data. 
[0100] When the thumbnail corresponding to one of 
images stored in the image server 400 is selected, the 
selected image may be transferred from the image serv- 
er 400 to a device other than the digital camera 300. For 
example, the image data may be sent to a printing ma- 
chine connected to the public network 703 to use an im- 
age data printing service. Also, the image data may be 
transferred to a user's personal computer other than the 
digital camera 300. In such a case, the thumbnail of the 
image to be transferred is selected and the destination 
is designated through the operation unit 301 . The se- 
lected image may be output from a printer connected to 
the image server 400 without being transmitted over the 
public wireless network. 

[0101] The present invention can also be applied 
even in a case where a person other than one who has 
registered an image in the server 400 extracts the image 
from the server 400. In this case, thumbnail data shown 
in Fig. 6 may be obtained by transfer from the person 
who has registered the image in the server 400. 
[0102] That is, when an image is registered in the 
server 400, the thumbnail shown in Fig. 6 is stored in 
the memory 302. The operator operates the operation 
unit 301 to perform the calling operation to the transfer 
destination and, after the establishment of connection 
to the transfer destination, transmits thumbnail data (to 
which discrimination information for searching is add- 
ed). On the other hand, at the transfer destination, a re- 
sponse to the incoming from the transfer source is made 
and, after the establishment of connection to the transfer 
source, the thumbnail data is received. The transfer 
source terminal then cuts the connection to the transfer 
destination. Thereafter, the transfer source terminal ac- 
cesses the server 400, sends discrimination information 
corresponding to the image to be viewed to the image 
server 400, and receives the image stored in the server 
400, as it does by F6 to F1 1 shown in Fig. 1 . In this case, 
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thumbnail data shown in Fig. 6 may be obtained from a 
memory medium such as a compact disk (CD) without 
transmission over the public wireless network 703. 
[01 03] The present invention has been described with 
respect to preferred embodiments thereof. However the 
present invention is not limited to the configurations of 
the above-described embodiments, and various modifi- 
cations and changes of the described embodiments 
may be made without departing from the scope of the 
invention as set forth in the appended claims. 



Claims 

1 . A communication device (300) comprising: 

memory means (302) for storing image data 
and thumbnail data; 

transmission means (307) for transmitting the 
image data to an image storage unit (400); and 
selection means (301) for selecting the thumb- 
nail data stored in said memory means, 

characterized in that 

said memory means (302) increases, accord- 
ing to transmission of the image data by said trans- 
mission means, an area where data can be stored; 
and 

said transmission means (307) transmits to 
said image storage unit asearch request for search- 
ing for the image data corresponding to the thumb- 
nail data selected by said selection means. 

2. A communication device according to claim 1 , said 
memory means increasing the area where data can 
be stored by erasing the image data transmitted by 
said transmission means. 

3. A communication device according to claim 1 , said 
memory means (302) storing moving image data 
and typical scene data, said transmission means 
(307) transmitting the moving image data to the im- 
age storage unit, and said selection means (301) 
selecting the typical scene data stored in said mem- 
ory means, 

wherein said memory means (302) increases, 
according to transmission of the moving image data 
by said transmission means, an area where data 
can be stored; and 

said transmission means (307) transmits to 
said image storage unit a search request for search- 
ing for the detailed image data corresponding to the 
typical scene data selected by said selection 
means. 

4. A communication device according to claim 1 , said 
transmission means (307) transmitting the image 
data and user information to the image storage unit 
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through a public network, wherein the user informa- 
tion is used for identification of a user from the public 
network. 

A communication system comprising a communica- 
tion device (300) and an image storage unit (400) 
connected to said communication device (300) 
through a public network (703), 

said communication device (300) comprising: 
memory means (302) for storing image data and 
thumbnail data; transmission means (307) for trans- 
mitting the image data to the image storage unit; 
and selection means (301) for selecting the thumb- 
nail data stored in said memory means; and 

said image storage unit (400) comprising: 
storage means (402) for storing the image data; de- 
tection means (405) for receiving a search request; 
and search means (408) forsearching for the image 
data stored in said storage means, 

characterized in that 

said memory means (302) increases, accord- 
ing to transmission of the image data by said trans- 
mission means . an area where data can be stored; 

said transmission means (307) transmits to 
said image storage unit a search request forsearch- 
ing for the image data corresponding to the thumb- 
nail data selected by said selection means; 

said detection means (405) detects user in- 
formation used for identification of a user from the 
public network; and 

said search means (408) searches, according 
to the user information, the image data stored in 
said storage means. 

A method of data communication with an image 
storage unit (400), comprising the steps of: 

transmitting image data stored in a memory 
(302) to the image storage unit (S1 036); 
increasing, according to transmission of the im- 
age data in said transmitting step, an area in 
the memory where data can be stored (S1037); 
selecting thumbnail data stored in the memory 
(S942); and 

transmitting to the image storage unit a search 
request for searching for the image data corre- 
sponding to the thumbnail data selected in said 
selecting step (S1144). 

A communication program for performing data com- 
munication with an image storage unit (400), or a 
storage medium in which said program is stored, 
said program comprising the steps of: 

transmitting image data stored in a memory 
(302) to the image storage unit (S1036); 
increasing, according to transmission of the im- 
age data in said transmitting step, an area in 
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the memory where data can be stored (S1 037); 
selecting thumbnail data stored in the memory 
(S942); and 

transmitting to the image storage unit a search 
request for searching for the image data corre- s 
sponding to the thumbnail data selected in said 
selecting step (S1144). 
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